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Abstract. The problem of symmetric rank-one approximation of symmetric tensors is important 
in Independent Components Analysis, also known as Blind Source Separation, as well as polynomial 
optimization. We analyze the symmetric rank-one approximation problem for symmetric tensors 
and derive several perturbation results. Given a symmetric rank-one tensor obscured by noise, we 
provide bounds on the accuracy of the best symmetric rank-one approximation for recovering the 
original rank-one structure, and we show that any eigenvector with sufficiently large eigenvalue 
is related to the rank-one structure as well. Further, we show that for high-dimensional symmetric 
approximately-rank-one tensors, the generalized Rayleigh quotient is mostly close to zero, so the best 
symmetric rank-one approximation corresponds to a prominent global extreme value. We show that 
each iteration of the Shifted Symmetric Higher Order Power Method (SS-HOPM), when applied 
to a rank-one symmetric tensor, moves towards the principal eigenvector for any input and shift 
parameter, under mild conditions. Finally, we explore the best choice of shift parameter for SS- 
HOPM to recover the principal eigenvector. We show that SS-HOPM is guaranteed to converge to 
an eigenvector of an approximately rank-one even-mode tensor for a wider choice of shift parameter 
than it is for a general symmetric tensor. We also show that the principal eigenvector is a stable 
fixed point of the SS-HOPM iteration for a wide range of shift parameters; together with a numerical 
experiment, these results lead to a non-obvious recommendation for shift parameter for the symmetric 
rank-one approximation problem. 
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1. Introduction. The symmetric rank-one approximation of a symmetric tensor 
has at least two important applications. One is Independent Components Analysis, 
known in signals processing as Blind Source Separation fP,^. First, we recall classi- 
cal Principal Components Analysis (PC A). PCA identifies a basis for a set of random 
variables that diagonalizes the covariance matrix, in other words a basis where the 
random variables are uncorrelated. This is necessary but not sufficient for indepen- 
dence. A stronger test for independence is to check whether the off-super-diagonal 
elements of the four- way cumulant tensor, a symmetric tensor defined from the fourth- 
order statistical moments, are zero. A linear transformation that achieves this can be 
identified by writing the tensor as a sum of symmetric rank-one terms; one approach 
uses successive symmetric rank-one approximations 

Another important application of the symmetric rank-one approximation of sym- 
metric tensors is in the optimization of a general homogeneous polynomial over unit 
length vectors, i.e. the unit sphere [8]. For instance, the symmetric rank-one variant 
of the "Time Varying Covariance Approximation 2" (TVCA2) problem [1^ can be 
written 

T 

^.^%Xy^^-)'' (1-1) 

where {At : t = 1 . . . T} are a given set of covariance matrices, and the vector norm is 
the 2-norm (as are all subsequent norms unless otherwise indicated). The argument of 
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is a degree-4 homogeneous polynomial, and so as we will see the TVCA2 problem 
can be represented as the best symmetric rank-one approximation of a symmetric 
tensor. 

Some things are known about the symmetric rank-one approximation problem. 
The best symmetric rank-one approximation in the Frobenius norm corresponds to 
the principal tensor eigenvector, and also the global extreme value of the generalized 
Rayleigh quotient [3, A, • It is not clear that these facts help us solve the symmetric 
rank-one approximation problem, because tensor computations are generally notori- 
ously difhcult. For instance it is known that (asymmetric) rank-one approximation 
of a general mode-3 tensor is NP-complcte. However, there is an algorithm, the Sym- 
metric Shifted Higher Order Power Method (SS-HOPM) 4 , that is guaranteed to 
find symmetric tensor eigenvectors. 

We address several questions pertaining to the rank-one approximation of sym- 
metric tensors. In Section |31 we address the structure of approximately-rank-one 
symmetric tensors. A symmetric rank-one tensor obscured with noise has a best sym- 
metric rank-one approximation that may not be the same as the original unperturbed 
tensor; how close is it? Is only the principal eigenvector related to the rank-one struc- 
ture? For a given symmetric approximately-rank-one tensor, how well-separated is 
the principal eigenvalue from the spurious eigenvalues? In Section 21 we consider the 
application of SS-HOPM to approximately-rank-one symmetric tensors. How is the 
convergence of SS-HOPM affected by the approximately-rank-one structure? When 
does SS-HOPM find the principal eigenvector? We employ a perturbation approach 
to prove six theorems that provide insight all these questions. 

2. Background and notation. A tensor is a multi-dimensional array of num- 
bers. The number of modes of the tensor, m, is the number of indices required to 
specify entries; a mode-2 tensor is a matrix. The range of permissible index values 
(ni, . . . rijn) are the dimensions of the tensor; if all the dimensions are the same, as 
with symmetric tensors, we simply write n. A symmetric tensor has entries that are 
invariant under permutation of indices. For instance, for a mode-3 symmetric tensor 
A, we have A123 = .A231. In this paper, tensors will be represented with script capital 
letters, matrices with capital letters, vectors with lower-case letters, and real numbers 
with lowercase Greek letters. Integers such as indices, dimensions, etc. will also be 
lowercase letters (e.g. m,n,i . . . ). 

A symmetric rank- one tensor is the outer product of a vector with itself, which 
we denote using the (g) operator. For instance, given the vector a, we can construct a 
symmetric rank-one tensor 

(a(^(g) — a)iiJ2...i„ = (a®™)iii2...i„ = fli^aj^ . . .a^^ . (2.1) 

^ V ^ 

m times 

The rank of a symmetric tensor A is the fewest number of symmetric rank-one terms 
whose sum is A. 

Generally, the m — r product of the m-mode tensor A with the vector a; is the 
r-mode tensor defined 

n 

(./^X — ^ ^ Ai^__i^Xi^^^ . . . Xj^ . (2.2) 

ir+i,...im = l 

The special case r = evaluates to a scalar and, under the constraint ||x|| = 1, is 
called the generalized Rayleigh quotient [12] . Interestingly, any degree-m homogenous 
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polynomial, such as (jl.ip . can be written as Ax'"^ for some symmetric tensor A and 
indeterminate x. In a miracle of notation, the derivatives are conveniently represented. 
The gradient may be written [?1 

VAt™ = mAx"'-^ , (2.3) 

and the Hessian may be written [1] 

V^^x™ = m(m - I'jAx""-^ . (2.4) 

The problem of maximizing the generalized Rayleigh quotient has the following La- 
grangian: 

£{x,fi)^Ax"'+n{x^x-l), (2.5) 

where /i is the Lagrange multiplier. Using (|2.3I) . we see the critical points of (|2.5p 
satisfy the following symmetric tensor eigenproblem 

Ax""-^ = Aa; . (2.6) 

Solutions to (j2.6p with ||a;|| = 1 are called Z eigenvalues and eigenvectors [7] to 
distinguish (j2.6l) from other tensor eigenvector problems, but here we will simply call 
them eigenvectors and eigenvalues. Together, we call an eigenvector and eigenvalue an 
eigenpair. The principal eigenvector/value/pair is that corresponding to the largest- 
magnitude eigenvalue, which may not be unique. For instance, if (x, A) is an eigenpair, 
then if m is even so is (— x. A), otherwise if m is odd then so is (— x, — A) We will 
restrict our attention to real solutions to (12. 6p . 

We note that symmetric tensor eigenvectors do not share all the properties of 
symmetric matrix eigenvectors, for instance they may not be orthogonal. Z eigen- 
vectors are not scale-invariant so limiting our discussion to normalized eigenvectors 
is important. Finally, we note that because of the relationship between (12. 6p and 
(j2.5p . the principal eigenvector corresponds to the extreme value of the generalized 
Rayleigh quotient, and the outer product of the principal eigenvector with itself, times 
the principal eigenvalue, is the best symmetric rank-one approximation of A in the 
Frobenius norm [3l [5] . 

The Shifted Symmetric Higher Order Power Method (SS-HOPM) [4], for a sym- 
metric tensor A, consists of the iteration 

_ Ax"^-' + axk 
\\Ax,^ + axk\\ 

where a is a scalar shift parameter. An eigenvector x is a stable fixed point of this 
iteration provided that the Hessian matrix for (j2.7l) is positive semidefinite at x. That 
condition is known 0] to be equivalent, for all y _L x and ||y|| = 1, to 



(m - l)y'^Ax"^^'^y + a 



< 1 . (2.8) 



It is known [4] that eigenpairs corresponding to local maxima of the generalized 
Rayleigh quotient (called negative stable eigenvectors) are stable fixed points of SS- 
HOPM provided a > /3{A), where 

/3{A)^{m-l) max piAx""-^) , (2.9) 

x: I |a; 1 1 — 1 
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and p returns the spectral radius of a matrix. Further, it is known ^4^ that if a > /3(-4), 
the SS-HOPM iteration monotonically increases the generahzed Rayleigh quotient and 
converges to a tensor eigenvector. It is not clear how to compute fi{A), but we have 
the crude bound [4] 

< /3(^) - (m - 1) ■ (2.10) 

ili2---im 

The following three properties are useful. 

Lemma 1. For any n dimensional vectors a and x, nonnegative integers m and 
< r < m, the following holds: 

(a®")a;"'-'' = (a^a;)"-''a®'' . (2.11) 



Proof. We use (g^l) and ((2T 



((a®'")x™-0,^...,^ = i^^nn,...i^x,.+,-.-X,^ (2.12) 

ir+l...im = l 
71 

— ^ ^ ai-^ai^ . . . • ■ • •^ijn (2--13) 

ir+l,...im=l 

= (a^a;)'"-'-(a'"^).i...v ■ (2-15) 

□ 

Lemma 2 (Kolda and Mayo 2011 [4]). For any m-mode symmetric tensor A, 
and any unit-length vector x, 

l^^mj < ^ (2.16) 

m — 1 

Lemma 3. -For any m-mode symmetric tensors A and B, any vector x, and 
nonnegative integers m and < r < m, we have 

{A + 6)x™-'' = Ax""^"- + Bx"'-"- . (2.17) 

Lemma ^ follows directly from the definition of tensor-vector multiplication in 
(Ell). 

3. Structure of approximately-rank-one symmetric tensors. Define 

A^X-a^'"'+£, (3.1) 

where a is a unit-length n dimensional vector and i5 is a symmetric tensor represent- 
ing noise. Clearly if f = 0, then (a, A) is a principal eigenpair, and all unrelated 
eigenvalues are zero. Now let us consider how close is (a, A) to a principal eigenpair 
when £ 0. 

Theorem 1. Let A be defined by iS.l]) . Then a principal eigenvalue Xp obeys 

<|X,|<|AKm, (3-2, 



m — 1 m — 1 
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and the angle 6 between a and the corresponding principal eigenvector Xp is bounded 
by 

|cos".|> 1-^11^. (3.3) 

Proof. Since {xp,Xp) are a tensor eigenpair, and ||a;p|| — 1, we have 

Ax'^ = Xp . (3.4) 

Using Lemma [31 we can write 

Xp = Ax;' = A(a®")x™ + £x;' . (3.5) 

Applying Lemma [T] we get 

Xp = Xix^a)"" +£x';; = Xcos"'9 + £x:;; , (3.6) 

where 6 is the angle between Xp and a. We can use the fact that |cos6'| < 1 together 
with Lemma [2] and the triangle inequality to obtain the bound 

|Ap|<|A| + ^. (3.7) 
m — 1 

We also know that Ap, as a principal eigenvalue, is a largest-magnitude extremum of 
the generalized Rayleigh quotient. In particular, 

|Ap| > l^a"! . (3.8) 

Now, using Lemmas [U [21 and [3l we get 

|Ap|>|A + £-a™|>|A|-^^. (3.9) 

TO — 1 

This establishes the first part of the theorem. 
Now, we can combine p.6p with p.9p to get 

\Xcos"'9 + £x"'\>\X\--^^. (3.10) 

TO — 1 

Using Lemma [2] we have 

|cos™0|>l--M^. (3.11) 
|A| (to - 1) 

□ 

Theorem [1] means that as P{£) approaches zero, then Xp approaches a or —a. So, 
if the noise is small, then the symmetric rank-one approximation of A corresponding 
to the principal eigenpair is close to the symmetric rank-one tensor that we seek. 

We would like to find the principal eigenpair. However, SS-HOPM will find any 
eigenvector corresponding to a local maximum of the generalized Rayleigh quotient 
(or local minimum, under appropriate modifications). The following theorem shows 
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that if jylx™! is sufficiently large and /3(-4) is sufficiently small, then x tells us about 
a even if it is not a principal eigenvector. 

Theorem 2. Let A be defined as in and assume, for some x so that 
\\x\ \ = 1, we have 

l^x'"! >e™ + ^^ , (3.12) 
m — 1 

where e > 0. Then 

|a^x|>e. (3.13) 



Proof. We have 



\Ax"'\^\ia^xy" +£x"'\ (3.14) 
<\aT:,r + J^, (3.15) 

' ' 771—1 

The proof is by contradiction. Suppose \a'^x\ < e. Then 

l^x™! <e" + ^^ . (3.16) 

777 —1 

But this contradicts our assumption. □ 

Another interesting question is whether the principal eigenvalue is "well sepa- 
rated" for an approximately rank-one symmetric tensor. Unfortunately, we do not 
know how to characterize the distribution of the spurious eigenvalues, but we can 
characterize the distribution of the function of which they are critical points. 

Theorem 3. Let a be an n-dimensional vector so that \\a\\ = 1. Let x be an n- 
dimensional vector so that \ \x\\ = 1, where x is drawn randomly from the unit sphere. 
Then 

Pr{\a^x\ > e) < -!- . (3.17) 



As a consequence, if A is defined by iS.ll) . then 



Pr( >e" + ^^^ < ^ . (3.18) 



777 



Proof. Because of the rotational symmetry of the uniform distribution on the 
sphere, the distribution of a^x is identical to efx for any i, where is a standard 
basis vector. In particular, Eejx — Ea^x and Var(efa;) = Var(a^a:;). Evidently 
Eejx — since x is uniform across the unit sphere. So we can write 

Var(ef x) = E{elxf - {Eelxf = E{elxf . (3.19) 

Next, using the symmetry of the uniform distribution, together with the linearity of 
expectation and the fact that x is unit length, we obtain 

n 

nE{elxf ^ EY^{eJxf ^ El^l . (3.20) 

1=1 
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So Var(a"^a;) — 1/n. Using Chebyshev's inequality, we can write 
Let e = k/ ^/n, then 

Pr(|a'^a;| > e) < ^ . (3.22) 

Then (|3.18l) fohows from a direct apphcation of Theorem [21 □ 

Theorem [3] shows that if A is high-dimensional (n is large), then the generalized 
Rayleigh quotient is mostly small. Consequently, the principal eigenpair should be a 
prominent extremum of the generalized Rayleigh quotient. 

4. Application of SS-HOPM to approximately-rank-one symmetric ten- 
sors. Let us consider the SS-HOPM method applied to the tensor in Through- 
out this section, to simplify discussion, we restrict our attention to A > 0. If m is odd, 
then the eigenvalues come in pairs ±A, one of which is positive, so at least one princi- 
pal eigenpair is a global maximum of the generalized Rayleigh quotient. If m is even, 
then Theorem [1] provides that a principal eigenvector Xp must be close to —a or a, 
which shows us Ap « A > so it is also a global maximum of the generalized Rayleigh 
quotient. So, with A > 0, we may restrict our attention to negative stable eigenpairs, 
namely those corresponding to maxima of the generalized Rayleigh quotient, which 
simplifies discussion of SS-HOPM. 

Let us identify a bound on the shift parameter a to guarantee a given negative- 
stable eigenpair (those corresponding to local maxima) of A, as defined in (|3.ip . is a 
stable fixed point of SS-HOPM. 

Theorem 4. Let A he defined as in liS. 1]) . and {xp,Xp) be a negative-stable 
eigenpair. Let 6 be the angle between x and a. Then x is a stable fixed point for 
SS-HOPM provided 

-Ap + (m- l)A|sin6lcos™-2 6'| + 13{£) 

< a . (4.1) 



Proof. From (|2.8p . the condition for a stable eigenvector Xp is, for y _L Xp, 

(m - l)y'^Ax'^-^y + a 



Xp -\- a 



< 1 . 



(4.2) 



In fact, for negative stable eigenvectors, the expression within the norm is always less 
than one [4], and we only need to worry about the lower bound 



^ ^ (m - l)y'^Ax^^^y + a 



Xp -\- a 



(4.3) 



Applying the definition of A in p.ip . Lemmas [3] and [TJ and the definition of 9, we get 



^ ^ (m - 1)?/^ (Aaa^ cos™-^ q ^ £x^-^) y + a 



Xp a 



(4.4) 
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Using the fact y'^XpX^y — 0, together with the properties of canonical angles between 
subspaces [SI P- 43], we can write 

\y^aa^y\ = |y^(aa^ - Xpx1)y\ (4.5) 
<sin6l. (4.6) 

Together with (|2.9I) , we substitute into (|4.4I) , taking advantage of Ap + a > (required 
for convergence), to get 

-(to - 1)A Isin^cos^-^g/l _ B(g) + a 
-I < ^ (4.7) 

Ap + a 

-Ap-a<-(TO-l)A|sin6'cos™"2 6'| -/?(£■) + a , (4.8) 

and solving for a, we get 

-A„ + (to - 1)A |sin6lcos™-2g)| ^.^j'^:) 

< a . (4.9) 

□ 

In the limit where [3{£) is small, we know by Theorem [T] that sin6' is smah and, 
using the discussion above to address signs, Ap « A. So our requirement simplifies 
to —A/2 < a. This bound is much smaller than a > ${A) provided in |4 . On the 
other hand, for general eigenvectors where sin0 is not small, but /?(£ ) is small, our 
requirement simplifies to A(to/2 — 1) < a. So a in the range —A/2 < a < A(to/2 — 1), 
the positive principal eigenvector may be a stable fixed point but spurious eigenvectors 
may be unstable. 

Let us move on to the question of the basin of attraction. To simplify the problem, 
we consider SS-HOPM applied to an unperturbed rank-one symmetric tensor 

^ = A • a®" . (4.10) 

It is obvious that the unshifted power method, i.e. SS-HOPM with a = 0, converges 
to a from x in one step provided that a^x ^ 0, because the "range" of the operator 
Ax™~^ consists only of the vector a. We note that if x is chosen randomly, a^x ^ 
with probability one. When a ^ 0, convergence is not obvious, but we can show that 
under mild conditions, SS-HOPM moves towards the principal eigenvector. 

Theorem 5. Let A be defined as in |7T7^, with A > 0. Let xi be a vector so 
that \\xi\\ — 1, and let 7 = a^xi. Assume 7™"^ > 0. Let X2 be the updated vector 
under SS-HOPM. Then \a'^X2\ > I7I provided 

-At™ "2 

a> ^ . (4.11) 



Proof. Let us decompose Xi into its projection onto a and its orthogonal compo- 
nent. 



Xl = 7a + SXa± 



(4.12) 
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Evidently 7^ 



1, and a^Xi — 7. From (12.71) . and using Lemma [TJ we have 



X2 











- ax\ 1 1 




A7'"~ia- 


f Q;7a + 


a8xa\_ 


||A7™-ia - 


f a^a -\ 


a8xa\_\\ 


(A7™-i + 


Q;7)a + 


abxa^ 


v/(A7™-i 


+ a^iY 


+ (a(5)2 



and so 



T 

a X2 



A7^ 



a7 



v/(A7™-i+a7)2 + (a<5)2 



Evidently a"^a;2 > I7I is equivalent to 



A7^ 



Q!7 



v'(A7'"-i +07)2 
A7'«-2 



(a(5)2 



a 



07)2 
IA7 



>l7l 



> 1 



(a5)2 



(l-7')(A7'"-' + a)' > M)2 

^2(Ay»-2+c^)2 > (^^)2 

(52A7™-2(Ay»-2 + 2a) > . 

Now, since J2 > Q, A > 0, and 7'"~2 ^ ^jjjg jg equivalent to 

_A7"-2 
a > . 



(4.13) 
(4.14) 
(4.15) 

(4.16) 

(4.17) 

(4.18) 

(4.19) 
(4.20) 
(4.21) 
(4.22) 
(4.23) 

(4.24) 



Let us discuss the requirement 7™~2 > Pqj. even, this is true for all xi 
given a^xi 7^ 0, and so Theorem [S] provides that SS-HOPM moves ANY input vec- 
tor towards a with probability one. When m is odd, the property holds for half of 
the choices of xi. However, it is easy to check using (|4.16l) that the sign of 7 is pre- 
served under the SS-HOPM update, so repeated applications of SS-HOPM repeatedly 
improve Xi. 

It would be nice to generalize Theorem [5] to the case £ 0. However, it cannot 
hold in the same form because a is not necessarily a stationary point of SS-HOPM 
in that case. Nonetheless, if the basin of attraction varies smoothly under small 
perturbation to the original tensor, then we expect the basin of attraction for the 
principal eigenvector to be large for small £. 

We have one more interesting result on the application of SS-HOPM to approximately- 
rank-one symmetric tensors, but it only holds for even-mode tensors. 

Theorem 6. Let A be defined as in 113. 1]) . and assume X > 0, m is even, and the 
shift parameter a for SS-HOPM satisfies a > P{£)- Then SS-HOPM always increases 
the generalized Rayleigh quotient and converges to an eigenvector. 
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Proof. Define 

f{x) = Ax"" + {ma/2){x'^x) . (4.25) 

Notice that the second term of f{x) is constant on the unit sphere, and the SS-HOPM 
iteration can be written 

This iteration is known [3J|3] to increase j(x) and converge to an eigenvector provided 
V^/(x) is positive semidefinite symmetric (PSSD). We can write 

VV(a;) = m{m ~ l)Ax"''^ + mal (4.27) 
= m{m - l)\{a^x)"'-^aa^ + m{m - VjEx"^-^ + mal . (4.28) 

Since A > and m is even, the first term is PSSD. So it is sufficient to show that the 
remaining terms 

m(m - l)£x"'-^ + mal . (4.29) 

sum to a PSSD matrix. But since the last term is merely a spectral shift, this is 
assured provided 

mmma-m{m-l)p{£x"'~'^)) > , (4.30) 

X 

which can be written 



a > /3{£) . (4.31) 

□ 

We conducted a numerical experiment that illustrates the theorems in this section. 
We define a tensor A with n = 100 and m — 4, and pick a = (1, 0, . . . ). To be able 
to use n even this large, we need to define £" as a sparse tensor. To generate £, we set 
£ = 0, pick 500 indices at random, and populate those entries with random Gaussian 
numbers, zero-mean unit- variance. We then permute those indices in all 24 possible 
ways and copy values to make £ symmetric. Finally, we scale the elements so that 
I3{£) = 0.03, and so P{A) « 3. 

Now, we let a range from —1 to 5, and apply the shifted power method with 10 
random starts. Let x be the output of the SS-HOPM, then a success is defined by 
\a'^x\ > 0.9. Fi gure 14.1 1 illustrates the success rate as a function of a. To compute 
c^min we combinc Theorem[T]and Theorem^ to get amm = —0.3365 for the principal 
eigenvector and amin = 1.015 for the spurious eigenvectors. Evidently the best chance 
of success for converging to the principal eigenvector is between these two choices of 
a; the fact that the success rate can be almost 100% is supported by Theorem [5l 
Choosing a > /3{A), even though it guarantees the SS-HOPM iteration increases the 
generalized Rayleigh quotient and converges, does not have the best chance of success 
for recovering the principal eigenvector. We speculate that choosing large a results 
in more spurious eigenvectors being stable fixed points of the SS-HOPM iteration, 
resulting in more spurious answers. 
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Fig. 4.1. Success rate for finding the best symmetric rank-one approximation of a symmetric 
tensor, as a function of shift parameter a. The values for a^in come from Theorem \4\ for the 
principal and spurious eigenvectors. Recall a > amin sufficient but not necessary for stability. 
The best performance for SS-HOPM on rank-one approximation is when a is about the Theorem \4\ 
threshold for the principal eigenvector but below the threshold for the spurious eigenvectors. 



5. Conclusion. Our perturbative analysis establishes new facts about the struc- 
ture of approximately-rank-one symmetric tensors, and the application of SS-HOPM 
to the rank-one approximation problem. We bound the closeness of the best symmet- 
ric rank-one approximation, and show that any sufhciently-large eigenpair informs us 
about the rank-one structure. We show that in high dimensions, most of the gener- 
alized Rayleigh quotient, whose critical points correspond to eigenvalues, is close to 
zero; as a consequence, the principal eigenvalue is prominent. We establish that for 
rank-one symmetric tensors, under mild conditions, SS-HOPM always moves an input 
vector towards the principal eigenvector. We also show that the principal eigenvector 
is a stable fixed point for SS-HOPM under a wide choice of shift parameters, and that 
SS-HOPM is guaranteed to converge to an eigenvector for a much smaller choice of a 
in the approximately-rank-one case (for an even number of modes) than the general 
case. A complete characterization of the basin of attraction for the principal eigen- 
vector remains an open question. Finally, it is hoped that better understanding of the 
symmetric rank-one problem may lead to better of understanding of more complicated 
problems such as Independent Components Analysis. 

6. Acknowledgements. Thanks to Mark Jacobson, Urmi Holz, Tammy Kolda, 
Dianne O'Leary, and Panayot Vassilevski for useful observations and guidance. 



REFERENCES 



[1] LiEVEN DE Lathauwer, Pierre Comon, Bart de Moor, AND Joos Vandewalle, Higher- 
order power method — application in independent component analysis, in Proceedings of 
the International Symposium on Nonlinear Theory Applications, 1995, pp. 91-96. 

[2] Christopher Hillar and Lek-Heng Lim, Most tensor problems are NP hard 
(http://arxiv.org/abs/0911.1393). 

[3] Eleftherios Kofidis and Phillip A. Regalia, On the best rank-1 approximation of higher- 
order supersymmetric tensors, SIAM Journal on Matrix Analysis and Applications, 23 
(2002), pp. 863-884. 

[4] Tamara G. Kolda and Jackson R. Mayo, Shifted power method for computing tensor eigen- 
pairs, SIAM Journal on Matrix Analysis and Applications, 32 (2011), pp. 1095-1124. 

[5] Lek-Heng Lim, Singular values and eigenvalues of tensors: a variational approach, in Pro- 
ceedings of the IEEE International Workshop on Computational Advances in Multi-Sensor 



12 



M. J. O'HARA 



Adaptive Processing, 2005, pp. 129-132. 

[6] V. Olshevsky, ed., Structured Matrices in Mathematics, Computer Science, and Engineering 
I, Contemporary Mathematics, American Mathematical Society, 2001, ch. Tensor approx- 
imation and signals processing applications. 

[7] LlcjUN Ql, Eigenvalues of a real supersymmetrie tensor, Journal of Symbolic Computation, 40 
(2005), pp. 1302-1324. 

[8] LiQUN Ql, Fei Wang, and Yiju Wang, Z-eigenvalue methods for a global polynomial opti- 
mization problem, Mathematical Programming: Scries A, 118 (2009), pp. 301-316. 
[9] G. W. Stew.'VRT and .Ji guang Sun, Matrix Perturbation Theory, Academic Press, 1990. 
[10] Huaiiua Waxc;, Arindam Banerjee, and Daniel Boley, Modeling time varying eovariance 
matrices in low dimensions. Tech. Report TR 10-017, Department of Computer Science 
and Engineering, University of Minnesota, 2010. 
[11] Yiju Wanc; and Liqun Qi, On the successive supersymmetrie rank-1 decomposition of higher- 
order supersymmetrie tensors, Numerical Linear Algebra with Applications, 14 (2007), 
pp. 503-519. 

[12] TONG Zhang and Gene H. Golub, Rank-one approximation to high order tensors, SIAM 
Journal on Matrix Analysis and Applications, 23 (2001), pp. 534-550. 



